4D-OR: Semantic Scene Graphs for OR Domain Modeling
نویسندگان
چکیده
Surgical procedures are conducted in highly complex operating rooms (OR), comprising different actors, devices, and interactions. To date, only medically trained human experts capable of understanding all the links interactions such a demanding environment. This paper aims to bring community one step closer automated, holistic semantic modeling OR domain. Towards this goal, for first time, we propose using scene graphs (SSG) describe summarize surgical scene. The nodes represent actors objects room, as medical staff, patients, equipment, whereas edges relationships between them. validate possibilities proposed representation, create publicly available 4D SSG dataset, 4D-OR, containing ten simulated total knee replacement surgeries recorded with six RGB-D sensors realistic simulation center. 4D-OR includes 6734 frames is richly annotated SSGs, object poses, clinical roles. We an end-to-end neural network-based generation pipeline, rate success 0.75 macro F1, indeed being able infer reasoning OR. further demonstrate representation power our by it problem role prediction, where achieve 0.85 F1. code dataset at github.com/egeozsoy/4D-OR .
منابع مشابه
On Support Relations and Semantic Scene Graphs
Rapid development of robots and autonomous vehicles requires semantic information about the surrounding scene to decide upon the correct action or to be able to complete particular tasks. Scene understanding provides the necessary semantic interpretation by semantic scene graphs. For this task, so-called support relationships which describe the contextual relations between parts of the scene su...
متن کاملDiscussion on ‘4D-Var or EnKF?’
The development of data assimilation techniques for numerical weather prediction has been very successful ever since the early 1950s until now, starting with simple two-dimensional and univariate spatial interpolation techniques like the successive corrections (SC, Bergthorsson and Döös, 1955) ending up with the four-dimensional variational data assimilation (4D-Var, Rabier et al., 2000) and en...
متن کاملLessons from scene graphs: using scene graphs to teach hierarchical modeling
The scene graph, as defined in VRML and Java3D, is a powerful tool for modeling a scene. The ideas contained in the scene graph are fundamental principles in modeling. They give beginning computer graphics students the tools to understand and apply the techniques of hierarchical modeling in scene design and can be directly applied to graphics programming in several graphics APIs, including Open...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-16449-1_45